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Abstract 


Comprehension monitoring was investigated by asking college students to read 
and recall passages that contained intentionally introduced confusions. 
Subjects were then told that confusions had been/present and were asked to 
describe them iad comment on how they affected comprehension. Subjects 
failed to report a surprisingly large proportion of the confusions. 


Confusions involving main points were detected more frequently than those 


involving details, and confusions of inconsistent information and unclear 
reference were more often reported than inappropriate connectives. 
Retrospective reports and analysis. of the recall protocols revealed that 
¥ failures to report confusions were often not due to failures to monitor 
comprehension but rather to the use of repair strategies to resolve the 


potential problems. 
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Comprehension Monitoring: Identifying and 


Pa 
Coping with Text Confusions 


Comprehension monitoring involves the evaluation and regulation of 
one’s own ongoing comprehension processes. To evaluate is to keep track of 
the success with which comprehension is proceeding, and to regulate is to 
ensure that the process continues smoothly, often by baking venediat setton 
ahi comprehension fails. Thus, readers who monitor chat? Sieneatmanian of 
text know when they understand, when they dente tedesetend: and when they 
partial}y understand. In addition, they know to test whether their 
ae ee is adequate for the purpose at hand, and when and how to deal 
with comprehension difficulties. Despite the obvious ioipabtavien of 
monitoring comprehension during reading, relatively little research 
attention has been directed to the process. A renewed interest in the 
cognitive processes underlying reading and the emerging area of inquiry 
known as metacognition have stimulated mugh theoretical speculation about 
the individual’s awareness and control of his or her own comprehension 
(e.g-, Anderson, in press; Brown, in press; Collins, Brown, & Larkin, in 
press; Markman, 1977, in press, Meichenbaum & Asnarow, in press; Miller, 
1976; Rumelhart, in press; Ruddell, 1976; Wertsch, 1978; Woods, in press; 
Flavell, Note 1; Markman, Note 2) but empirical investigations remain 
Scarce. | 

Comprehension monitoring has been studied indirectly by asking people 


to reflect about their comprehension processes. Olshavsky (1976-77) and 
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Olson, Duffy, and Mack (Note 5) used the technique of protocol analysis, 
asking subjects to talk aloud about, their thoughts and expectations as they 
were reading a passage clause by clause. Collins, Brown, and Larkin (in 
press), Smith (1967), and Strang and Rogers (1965) examined retrospective 
reports from subjects who were asked to talk about their reactions to a 
passage after they finished reading. Techniques such as these reveal the 
variety of strategies people use in their efforts towards comprehension, 
séetitatng Thorndike’s (1917) early analysis of reading as a problem solving 
process. Moreover, the results suggest that poor comprehension monitoring 
may be characteristic of poor readers. Though good and poor high school 
peadewe did not seem to differ in their identification and resolution of 
comprehension difficulties st the level of words and clauses (Olshavsky, 
1976-77), there were apparent differences in more sophiatieated monitoring 
Poor readers had less insight into the procedures they used during readin 


(Smith, 1967; Strang & Rogers, 1965) and were less likely to seek 


t, 
clarification of poorly understood information (Strang & Rogefs, 1965). 
Because the subjects in these experiments were specifically instructed 
to reflect on their comprehension processes, the studies séayiaa: tieté 
information about spontaneous comprehension monitoring. Moreover, the 
experimenters had no control over which apecivic sections of text readers 
might find confusing, and so it is difficult to draw conclusions about how 
effectively readers were monitoring their comprehension. These shortcomings 
can be remedied by manipulating the comprehensibility of the text itself; 


. 


failures to notice deliberately introduced confusions may provide evidence 
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of poor comprehension monitoring. This paradign has been used to study the 
development of comprehension monitoring skills (Markman, 1977, in press), je = 
well as referential communication (e.g., — & Patterson, 1978; ra 


Ironsmith & Whitehurst, 1978). \ 
4 


comprehension monitoring. In the 1977 study, children in first and thir 


grades listened to simple instructions on how to play a' game or| perform 


lcrucial to 


magic trick. In both cases, information was left out that was 


help was needed in coming up with good iene’ ions and that they should 1 


Or was unclear. The 


\ 


the experimenter know if something was omitted 


instructions for the card game were as follows: | 


We each put our cards ina pile. We both turn over the top car 


in our pile. We look at cards to see who Nas the special card. Then 
we turn over the next card in our pile to see who has the special card 


this time. In the end the person with the most cards wins the game. 


\ 


There was no mention of what the "special card" mi ht be. Markman found 


Gleam #3&;&;&;%ég@aseeeh Ae 


‘that the third graders realized the instructions ere incomplete much more 


eadily than the younger children. It was often not until the first graders | 
ysically tried to carry out the instructions ful they realized they 

didn’t understand. They may have felt they understood when, in fact they did 

not, suggesting that they had bean listening eaeatyety and not cere 


evaluating whether the instructions made ‘Sethe: 


or 
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Thus, Markman concluded that first graders did not monitor their 
comprehension effectively but that third graders did. However, it is 
relatively easy to test one’s understanding of instructions because they eat 
be evaluated by the success vith which some goal is-abeained: Monitoring 
comprehension of text is more difficult because the criteria for successful 
comprehension are less explicit: Readers must decide for themselves how 
well they need to understand, selecting their own stanaatae $62 evaluation. 
This suggests that the effectiveness of one’s comprehension monitoring may 
depend not only on age but also on the nature of the materials. Markman (in 
press) provided pea nteeits evidence fof this suggestion. Children in third, 
fifth, and sixth grades listened to short essays containing innaualaxont 
information and then answered questions designed to assess their awareness 


of the PR CUEC SESE STOR: Here is an example of one of the inconsistencies, 


taken from a passage about fish: 


Fish must have light in order to see. There is absolutely no 
light at. the bottom of the ocean. It is pitch black down there. When 
it is that dark the fish cannot see anything. They cannot even see 
colors. Some fish that live at the bottom of the ocean can see the 


color of their food; that is how they know what to eat. 


There is a conflict between statements that fish cannot see colors at the 
bottom of the ocean and that some fish can see the color of their food at 
the bottom of the ocean. Children in all grades tested were equally poor at 


hoticing the inconsistencies. Thus, although third graders reported when 
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they did Ok understand instructions, .children of the same age and ohder v 
failed to report suut iene in the expository passages. However, when P 
specifically warned that the passages contained nr te ee a greater 
ctepartion of children, primarily sixth graders, reported them. This te 
evidence that comprehension monitoring is facilitated when inet for 
evaluation are more explicit. 

Markman’ s experiments supplement the abundant evidence ve developeantal 
differences in cognitive monitoring tele. Brown, 1975, in press; Flavell, 
1978, Note 1; Flavell & Wellman, 1977). The studies discussed earlier are 
: suggestive of individual differences as well: High school students who are 
poor readers seem to lack awareness of their cognitive processes during 
reading (Smith, 1967; Strang & Rogers, 1965). Similarly, adults engaged in 
novel activities may lack appropriate strategies for evaluating and 
regulating their performance, as Chi (1978) has shown with novice chess 
players. Quite clearly, seanditiee monitoring is not an ability that simply 
develops with maturity, but is highly dependent on knowledge and experience 
(Brown & De Loache, 1978). , 

It ig therefore somewhat surprising that instruction incebeprehanston 
monitoring is not typically included in wehpol curricula. Despite some 
attention to the related’ areas of critical reading and gtudy skills, 
children are left on their dart to acquire expertise in thie important 
component of reading. Since many students who have shared weliexe still 
experience difficulty in the task of learning by reading (Anderson, in 


press), it may be that their comprehension monitoring skills are inadequate. 
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If poor comprehension monitoring ieee in fact, Gusce in mature. readers, 
then more attention should be devoted to the process rheoughaat the school 
years. 

The present study was a preliminary~investigation of college students’ 
comprehension monitoring abilities that combined two of the general = 
' paradigms previously described. Confusions were introduced into the text in 
order to pinpoint segments that should cause comprehension difficulties. 
Retrospective reports were collected in order to determine how the 
confusions affected the students’ processing of the information. In 
addition, recall protocols were obtained to assist in discovering how the 
confusions were comprehended. Three different types of confusions were 


introduced into expository passages: (a) inconsistent information§ where 


ideas in one sentence conflict with those of another (e.g., the word : 


"backwards" was substituted for the word "advanced" in a sentence evaluating 

the Inca economy, @hile subsequent sentences continued to describe positive 

aspects of the economy); (b) unclear reference, where the context does not 

specify which of several previously introduced nouns is the referent of a 
nonspecific phrase (e.g., the phrase "one type of novel" was substituted for if 
"the pastoral novel" in-a context where three different novel types are 

under dtacuseton);_and (c) inappropriate logical connective, where 

expectations about the kind of information that will follow a particular 

connective are violated (e.g., the word "therefore" was substituted for the 


word "“however"). 


Yor 
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The inconsistency confusions were included because an important aspect 
of comprehension involves integrating the ideas in different sentences into 
a meaningful whole. Conflicts between ideas should be noticed if readers 
are keeping track of their ongoing comprehension processes. The unclear 
reference problems were included because readers are often faced with the 
task of identifying anaphoric referents. Experiments have shown that 
subjects look back at previously read information and make regressive eye 


movements when dealing with anaphora (e.g., Carpenter & Just, 1977; Garrod & 


: Sanford, 1977). Failures to notice vague referents should therefore be a 


, 


good indication of failures to monitor comprehension carefully. The 
inappropriate connective confusions were included because an important , 
aspect of comprehension is following the logical relationships among the 
ideas in a text. Signal weula such as lcherefore,” "however," and "in 
addition" provide clues as to the type of information that should come next. 
Many guides to effective reading and study skills claim that atéeneaice to 
these transition words can be of great benefit to comprehension (e.g., Adams 
& Spira, 1978; Sparks & Johnson, 1971; Wood, 1978). If so, we would expect 
inappropriate signal words to be disruptive if readers are monitoring their 
comprehension. < 

A second manipulation in the study was the level of the confusion in 
the fext structure; that is, whether it involved a main point or a detail. 
One of the most prevalent findings in research on prose memory is that main 
ideas are remembered better than details (e.g-, Johnson, 1970; Kintsch, | 
1974; Meyer, 1975). Is this because main ideas are easier to retrieve or 


/ 
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in . 


because they are processed differently during reading? Carpenter and Just 
(Note 4) reported that subjects spent more time reading sentences containing 
main ideas than details, suggesting that the better memorability is in fact 
due to increased attention initially. This leads to the prediction that 


subjects should be more likely to notice confusions in main points than in 


details. : 
Method - 
‘Materials { 


The materials consisted of six 250-word passages that dealt with topics 
in world history. The passages were based on Cliff£’s Course Outline in 
World Civilization (Leon, 1970). Each of the three paragraphs in & passage 
focused on a separate aspect of the main topic. For example, in a passage 
about the Inca civilization, the first paragraph dealt with the ruler of the 
empire, the second with the economy, and the third with religion. The / 
middle paragraph of each passage was modified to tontain one of the three 
types of confusions described earlier: inconsistent information, unclear 
reference, or inappropriate connective. For each of the three confusion 
types, one passage contained a confusion at the main point level, while 
another contained a detail level confusion. The main point confusions were 
introduced near the beginning of the paragraphs and had bearing on the 
_ interpretation of the entire paragraph. The detail confusions appeared near 
the end of the paragraphs, and were related to only one or two other 
statements in the paragraph. ! Table 1 presents the target (middle) paragraph 


from each of the six passages. The underlined sentence is that which 


I] 
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contained the information creating a confusion. The words in parentheses 


are those which appeared in the "nonconfusing" versions of the passages read 


by control subjects. The nature of each confusion will be considered in the © 


ye 


Results and Discussion section of the paper. 


Insert Table 1 about here. 


It should be noted that these passage confusions were constructed on an ' 


intuitive level. Since the study was primarily éaplovakery, systematic 
criteria for determining confusion type and level were not established. In 
addition, the fact that different types of confusions were used should not 
be construed as an attempt to gain information about the role of specific 
confusion types in comprehension monitoring. Rather, different confusion 
types were used in order to reduce the likelihood that subjects would catch 
on to the fact that each passage contained a confusion. Since there was 
only one passage for each confusion type by level combination, we obviously 


cannot make generalizations about specific cells in the design. In 


presenting the results, the confusions will be considered separatel ut 
this is more for expository purposes than statistical. a 
Procedure aa 

SS a 


The experiment consisted of three parts: (a) Study. Subjects were 
= ; ' 
instructed to read all six passages carefully in preparation for subsequent 


"discussion" questions. @y were allowed to spend as much time on each 


passage as ae 


a 


Pe 


ae | jo 


ut were not allowed to reread previous passages. 


———e i — —— ae 2 Et ——w _— Se hy 


‘ ; | : 
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Subjects were not informed of the existence of the confusions at ‘this time. 
(b) Probed recall. Subjects were asked to answer "Describe and evaluate" 
sieeioee dealing with the target paragraph of each.passage. These 
questions are included in Table 1. The questions were designed to encourage 
complete recall of the target paragraph and exclude recall of fie ‘ 
surrounding paragraphs. Subjects were not permitted to look back at the 
passa e., It ts i ant to stress that the recall task is not intended to 
provide uaiaicg of confusion deotien, since subjects are free to 
dedekraet answers to the questions using whatever criteria they choose. 
However; the recall protocols should be useful in revealing whether subjects _ 
modified esceaba tants in some way to render chew more sensible. Thus, the 


results of interest from the recall task are qualitative rather than” 


quantitative. We are not so much interested in the amount of information 


subjects included: ‘in their answers, but rather the nature of the 


y 


information. In eras of the recall task, we will briefly ': 


consider quantitativé aspects by comparing the amount of confusion-related 


t @ 


infornation included in the responses of: the experimental and control 
subjects. However, the recall FEAPORUES are of primary interest for the 
Light they anes on the strategies subjects used during reading. The recall 
protocols will be considered from this perspective ‘in the final section of . 
the PaPSE © (c) Detection. The eu Jecne weré’ informed of the existence pe 
the confuatons, and the three types. were described. They were asked Wbether 


“they I had ipsticer the confusions during their initial reading of ae passages 


aes ee ots were -gevencan opportinity to meek them. Additional queertons:: 


nr 


13 


familiarity ratings were again requested. The control subjects were. 


‘two sessions, and they went through the booklets at their own pace. Average 


{ 

/ 

' ° ‘ | 
/ 


f 


if 
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probed how the confusions affected processing of the passage and spbsequent 


recall. These questions, included in Appendix B, are admittedly leading, 


but the best way to get subjects to reflect upon their strategies is to give 


them some examples of what is meant by strategy. The ideal technique would 
be to interview students individually, but even here, some leading questions 
would be needed in order to elicit kaeh taicvank feGsonnany Subjects wdce 
then asked ‘to provide comprehensibility and familiarity ratings of each 
passage. Complete instructions ‘to the subjects are presented ia Appendix A. . 

Fourteen University of Illinois undergraduates enrolled in an 
educational psychology course served as subjects in the experiment just 
described. Bight additional subjects read the consistent versions of each 
rer and answered the same probed recall questions. The Saleskioa 


questions were replaced by some general questions about the interest levél, 


\ St : 
clarity, and reading difficulty of the passages, but comprehensibility and 


included in order to compare recall and ratings of the confusing and non- 
confusing versions of the susnauans: 

' All of the materials necessary for the experiment were contained in a 
single booklet, along with complete instructions. The order of the passages 
was randomly deternined’ for each booklet, with the order of questions in 
Parts 2 and 3 the same as the ardes of the nanagnics Subjects were run in 


t 


completion timé was 40 minutes. 
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Results and Discussion 


This section of the paper is divided into five parts. The first part 
describes the nature of the confusions in each passage and the frequency of 
their detection. The second part compares the responses of the experimental 
and control subjects on the probed recall task. The third part reports the 
couprehensibility and familiarity ratings, and the fourth reports a test for 
correlations among the dependent variables. The final section examines. 


several procedures for dealing with the confusions ‘as revealed through 


analysis of the recall protocols and retrospective reports. 
4 


Confusion Detection 


Subjects’ responses to the questions in part 3 were scored as to 
whether or not they detected the confusions. In general, subjects were - 
quite poor at detecting the confusions; only 38% of the confusions were 


reported, even after subjects were explicitly instructed to search for them. 


OW = ebiabaa tase a ads 
Subjects, claimed to have ere of eh confusions during initial 
* reading + These figures suggest a rather Low level of comprehension 
wink torkad However, as will become clear later in the paper, failures to 
| report the confusions were often due to favkoracbeies chan poor 
| 


| comprehension monitoring. In other words, confusion detection cannot be 


taken as the sole index of compreh¢nsion monitoring, since subjects who 


 “yepair” the confusions are also comprehension monitors. 
) . ‘ 


nt 


hoof ‘ : . | : ' 
: # | , 
a : ° wa oe i he ST, “ 
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Table 2 presents the proportion of total detections for each passage, 
as well as the proportion of detections said to occur during reading. 
Overall, 622%° of the main point confusions were detected while only 142 of 
the detail confusions were detected. An analysis of variance revealed that 
thie difference was eetiatine F(1,13) = 68.42, p < .001, supporting he | 
initial expectation that main point confusions would be easier to detect 
than detail contunione: The apparent tendency to monitor one’s 
understanding of main points more carefully than of details is supported by 
a aie asia ae subjects provided for their failures to detect detail 
confusions. That is, subjects often explained that they had been reading 
for general ideas or decided the point was trivial. There were dlso 
reliable differences in the effect of confusion type, F(2,26) = 8.99, p < 
-001; inappropriate connectives were detected any frequently than 
inconsistencies or vague Seteniiedle: which did not differ in’ their 
detectability. The poor detection of inappropriate connectives was due to 
the fact that many subjects classified the problem as one of inconsistency. 
This point will be elaborated in the following discussion focusing on the 
individual passages. There was also a significant confusion type by level 
inieractair, F(2, 26) = 4.87, p < .05, ehh is due to the poor datewkton of 
the main point tueuueuars connective. Since this interaction is 
confounded with passages (each cell in. the design was represented by only 

-one passage), it is not readily interpretable. 
Inconsistencies. A ‘main-point inconsistency was introduced into the 


"The Empire of the Inca" passage. The first sentence contains the 


t 


if. . © gore 


a 
ee 
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information that sets up the inconsistency: the claim that the economy was 
backward. Although subsequent statements do nat eeiicdteiy contradict this, 
they do provide disconfirming evidence: A backward economy is unlikely to 
have such successful farming efforts and nd unemployment. This confusion 
was quite salient, as 10 of the 14 subjects noticed it. However, only four 
reported that they had noticed it during initial reading. At least one 
reason for the low during-reading detection rate was that sian aubdecte made 
inferences to resolve the inconsistency; e.g-, they assumed other aspects of 
the economy were backward. This point will be elaborated in the 


retrospective reports section. 


L “ood ft 


The detail-level inconsistency appears in the "Ggeat Satietwaanee 
Artists" passage in the statement, that da Vinci’s sketches lacked any future 
practicality. Considering the fact that the sketches of airplanes were done 
in the 16th century, they were actually quite remarkable portents of the 
future: This inconsistency probably cannot be detected on the basis of text 
ifdrmation alone; the reader needs ‘to know that the Renaissance took place 


hundreds of years ago and that airplanes did not exist until the 20th .. 


century. We felt reasonably sure that college students would possess this 


‘relevant background knowledge, but as it turned out, some of them had too 


much background knowledge. They knew enough about da Vinci’s sketches to 


know that his airplanes weren’t practical, that they couldn’t possibly fly. 


_ Thus, they brought in their prior knowledge to interpret this statement, 


thereby resolving the intended inconsistency. Because only three subjects 


reported the inconsistency, some colleagues were asked for their opinions 


i7 
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about the passage; “it was only then that the alternative yet plausible 
interpretation was discovered. 

Unclear references. The "Literature of the Spanish Renaissance" 
passage contains a coatuaien of unclear reference at the main point level. 
The problem with the text was that the novelwhtch had the greatest impact 
was never specified: "only one type... It would typically 
describe . . ¢" This vagueness was readily detectable: Thirteen subjects 
reported te and tén of a“ thirteen noticed it during reading. This 
provides further nee -Adentification of referents is a process 
which occurs ce reading (Garrod & Sanford, 1977). 

The fateredce confubion at the detail level appeared in "Political 
Development of Ancfent Greece." There were two vague referents in the final 
sentence of thé paragraphs it is din eliwae whose hold was broken, nor who 
paved the way for democracy. This vagueness was not a gontenn f4¢ most 
Subjects; only tae reported the confusion. However, three subjects reported 
- inconsistency in the statement that the tyrants were benevolent, 

detecting a conflict with chet prior knowledge about tyrants. Although it 
is true that tyrants are frequently oppressive or brutal, this is not a 

defining characteristic Since the reference problem was not very salient, 
subjects looked far a confusion elsewhere in an attempt to comply with task 


kh BOE 


neeindss 


Inappropriate connectives. The "Byzantine Civili zation® passage 


contains an inappropriate logical connective at the main point level. The 
word "therefore" at the beginning of the second sentence signals a logical, 


_ | 


f.; 
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daueal relationship between the ideas in the first and second sentences, 
while the appropriate connective, "however," signals an exception or change 
in the direction of thought. Only three subjects reported that "therefore" 
was inappropriate, but four reported that the ideas in the two sentences 
were inconsistent. The inconsistency was explained as follows by a typical 
subject: "The passage at first says the architecture was modeled after the 

on Greeks but then it gays it was unique.” Note that this explanation confuses 
"culture" with Vigeoheuctures” These subjects apparently failed to consider 
that architecture is but pie-angece of a country’s culture. Had they done 
80, they perhaps would have focused more on the inappropriateness of the 
transition word. 

The "French Religious Wars" passage contained an inappropriate logical 
connective at the detail level, but subjects again reported the confusion as 
one of inconsistency. The inappropriate eanpective was "therefore" in the 
final sentence of the cucapraghn namvenl is a more appropriate tata, 
since it does not follow from preceding context that Catherine would join 

: =F 
the conspiracy. What the subjects did pick up on as a confusion was 
Catherine’s inconsistent behavior: If she supported the Huguenots’; ‘why did 
she conspire against them? Ten of the fourteen subjects castes chi ae 
, the confusion while only one steetian it to an inappropriate logical 

‘ w ponnective. In contrast to the Byzantine passage, where tile reported Mec 
inconsistency was based on insensitivity to the culture-architecture ‘ 
distinction, the reported inconsistency in this passage was not based on 


4 
misunderstanding; Catherine’s behavior did seem inconsistent on the basis of 


19 
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ae the information given in the passage. This suggests that people are more 


j likely to attribute errors to the semantic relationship among ideas than to 
f 


4 


question the appropriateness of logical connéctives. 


Recall of Confusion-Related Information 


Subjects’ responses to the questions were/scored for "target relevance;" 
i.e., for those statements based on he: onfusing aspects of the paragraph. 
This included the sentence which contained die confusion manipulation itself 
as well as supporting information inv wad dn setting up the confusion. A 
lenient scoring criterion was used, counting as target-relevant any 
statement that was a paraphrase, elgboration, modification, or dtatoteies of 
the explicit information. (Note that this includes incorrect stapenmntited 


the confusing information; e.g., ‘the economy was "advanced" rather than 


"backwards.") In order to determine whether the presence of a confusion 


affected the likelihood of target-relevant recall, a comparison was made 


same criteris were used in scoring the’ responses of the control subjects. 


The proportions of target-relevant responses are presented in Table 3, 


Insert Table 3 about here. 


as a function of condition (experimental vs. control), confusion-type, and 
level. Overall, 40% of the experimental responses contained target-relevant 


information while 56% of the control responses did. An analysis of variance 


20 


J - i 
with the subjects who had re d consistent versions of the passages. The ba 
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showed that this difference approached but did not reach significance, 
: . 7 a. : ; ’ 


We. 


F(1, 20) = 3.11, p < .10. One explanation for this 162 diéféranee fa recall 

was that the sehaktannteal subjects jinev~a_ confusion was present and so 

decided to omit mention of it. In fact, several subjects reported wiiah 

deliberate response suppression. Another reason is that subjects remembered 

“tse infatwation as a result of the confusion; this is supported by several 

coments that the ‘confusion impaired memory. There were no differences in 
ve 


recall-of main point or detail level info fon, but there was a reliable | F 


effect of confusion type, F(2, 40) 4.62, p < .05, with the unclear 


‘ reference passages Wor @called, and the inappropriate connectives 


passages best 2 Called. There was also an interaction of confusion type and 
level, F(2,4) = 12.98, p <..001. However, since thare were no interactions 
with experimental condition, the differences are likely due to 


characteristics of the passages themselves rather than to the presence or 


absence of a confusion. 


Comprehensibility and Familiarity Ratings 

dukdeate were asked to rate the comprehensibility and familiarity of 
each passage a a scale ae ‘1 to 5, with 1 representing the lowest level 
and 5 che highest. Analyses of variance were performed on the ratings with 
condition (experimental ve. control) and passage as factors Since it was 


oe 


assumed that the ratings would vary considerably across passages, the 


“es 


fralyses were conducted with passage as a factor rather than confusion type 
and-level. The mean comprehensibility and familiarity ratings for each . 


‘passage are presented in Table 4, classified by experimental condition. 
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Insert Table 4 about here. 


The mean overall comprehensibility rating for the experimental subjects 
was 3.26 and for the control subjects, 3.65, a nonreliable difference. 
Thus, the steasied of a confusion did not result in decreased 
comprehensibility of the passages. However, the effect. of passage was 


reliable, F(5,100) = 5.91, p < .001. Multiple comparisons revealed that the 


“<o 


‘Literature passage had a significantly lower rating then all but the . 
Byzantine passage. The ratings for the Greek, Artist, Wars, and Inca 
passages’ did not differ significantly. The ratings parallel the probed 
recall results in that the Literature passage, which was poorly Caettiee 
was rated lowest in comprehensibility, and the Inca passage, which was well 
_— recalled, was rated high in comprehensibility. The analysis of variance 
| also revealed a significant passage by condition interaction, F(5,100) = 
2-32, p < -05, due to the fact that the control subjects gave the Wars 
passage their highest rating, while the experimental subjects gave it one of 
the lowest. : . : S 
The familiarity ratings for the experimental and control conditions did 
‘not differ significantly (2.23 vs. 2.29, respectively), nor did condition 
interact with passage. The effect of pagsage was reliable, F(5,100) = 8.82, 
‘ p< -001. The Literature passage, which had the loweat familiarity rating, 


was reliably different from the Inca, Artist, and Greek passages. The roku | 


passage, which had the highest rating, was reliably different from the 
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Literature, Wars, and Byzantine passages. The low rated familiarity of the 


Literature passage may also have been a factor in its low level of recall. 


Tests for Correlations Among the Dependent Variables 
_ . Correlational andieees were carried out to test for systematic 
relationships among the four dependent variables (recall, detection, rated 
comprehensibility, and rated familiarity). Since the control subjects did 
Rot contribute detection data, they were not included in the analyses. A 
\contetetian matrix based on mean scores for .each subject collapsed over 
passages is presented in Table 5. The comprehensibility and familiarity, 
ratings were positively but not significantly correlated. Thus ratings of 
higher comprehensibility were usually accompanied by ratings of high 
beutiincity, and similarly with low ratings. There was also a positive 
correlation between recall and detection, but again it was nonsignificant. 
Thus, subjects were somewhat more likely to detect a confusion if they 
recalled it and were less likely to detect a confusion if they did not 
recall it. Separate correlation matrices were also constructed Hor each 
passage, but of the 36 correlations, only three were significant at the .05 
level and two others were marginal (p < .10). These results therefore do 


not warrant further consideration. 


Insert Table 5 about here. 
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The quantitative analyses revealed that subjects were quite poor at 
detecting the intended confusions. Even though subjects were explicitly 
told that confusions were present and ware given examples of the three 
confusion types, the detection rate was only .38. Subjects reported that 
they had noticed 23% of the confusions as they vere ‘reading the passages for 


the first time. This figure, of course, is based only on subjects’ 


a 
‘ 


retrospective verbal reports but, if erroneous, is more likely to be~too 
high than too low. That is, subjects are probably more likely to say they 
noticed the confusion initially if in fact they did not than they are to say 
eney: did not notice the confusion initially if in fact ehiey: did. 

The low detection rate was partly due to the fact that many 
inappropriate connective confusions were identified as inconsistencies, 
indicating that subjects were better comprehension monitors than. the data 
sugeaet. If these detections are included in the totals, the overall 
detection rate increases to .55 and the during-reading rate to .34. Thus, 
subjects did test ideas for their consistency vieh one sigther, but focused 
more on the concepts themselves than. on the way they were logically 
connected: in the text. ‘Another reason for the low detection rate was that 
catierbn asia spontaneously a "fix-up" procedures to resolve the 
potential confusions without realizing they had done so. The use of fix-up 
procedures was discovered through inspection of the recall protocols and the 
retrospective reports subjects provided after being informed of the _ 


4 existence of the confusions. This information cannot be characterized 
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quantitatively, but is clearly of importance in the study of comprehension 
monitoring. This section of the paper will describe sone of these 
monitoring procedures. <i 

The most frequent procedure was to draw sige, prior Pkewlades to 
supplement explicitly presented information. For example, many subjects 


o 


decided that some relevant information had not been included in the text and 
so weal vine knowledge 6 bridge the gap. This inferencing strategy was 
rie applied in dealing With Anccnatuteneten, as the following excerpts 
from protocols on the Inca passage demonstrate. When asked to recall the 
paragraph, many subjects modified the information to be more dountatdte ich 
the general idea of a favorable economic situation. For example, one 
subject recalled; "The economic endieiee of the country was fairly 
developed and efficient." Another recalled; "The economy seemed like it 
worked vee aD atvleast in their own society." In post-test questioning 
sive pa ere her interpretation of the inconsistency: "The diesibas could 
still be backward yet have excellent acniipaenk™ A teerenpons subject 
explicitly includéd a resolving inference in her recall response: "The 
economy was backward « « « « .Although: they possessed relatively modern 
technology, they were not organized in an efficient economic manner." 


Another student’s explanation of how he dealt with the confusion was: "I 


thought another part was backward (such as distribution) and the author just 


4 


failed to explain it." . 
Even though the correlational analyses did not reveal a consistent 
relationship between rated familiarity and detection, prior know}edge 
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clearly played a role in interpreting the confusions\: .One subject, who 


Ae 


indicated by familiarity rating of 4 that she had a fair amount of 


evade about the Incas, eyatueeas the initial statement of "backwardness" 
with eeapack ‘to her prior knowledge rather than the content of the paragraph 
itself: "The culture would not be backward for its time," This 
interpretation is reflected in the ssh she qualified the inconsistent 
statement in her recall response: "The economy is ‘backwards’ as we know it 
today." a 

Prior knowledge also contributed to detection failures. A recall 
protocol from the Artists passage shows ine the sie teeteea , 
consistent interpretation upon the confusion: "He was ahead of his time in 
that he had paintings of space ships and tanks, but they are impractical in 
today’s world." Because the subject had prior knowledge about da Vinci’s 
sketches,: the text did not seem. inconsistent either upon initial reading or 
when instructed to. reread the passage Siiwdareh of a confusion. 

ye 2 


A related cause of ‘detection failure is assigning alternative 


interpretations to the text. Thus, readers may feel ‘they understand but in 


‘fact do not get the meaning the writer intended to convey. For example, one 


subject distorted’ the information in het eecali of the Wars ‘passage such 

chit Catherine "worked to get’ ‘rid of anyone who didn’t believe in religious 
freedom." This subject’s misunderstanding of the passage probably accounts 
for her failure to detect the confusion. She -had apparently imposed her own 


interpretation on the material so firmly that no other interpretation could 


‘be seen. — 
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. Subjects who- did nofice confusions during reading dealt with them in 
a ) Pa . ; - i x 
various. ways in their recall attempts. Some subjects included the confusing 
informatign in their anawers in a more or less. verbatim manner, even though 


they knew it. vas not wenatbie,’ae did the subject who eacul ved, "The economy 
of the. Incas was. extrengly biclenuct: They often made inferences to help 
resolve the confusions; but deliberately sa ua them in recall. For 
example, ‘40 the Ee reretuce passage, one subieck discussed the type of novel 
that had. an tapact vn the. same vague way it was discussed in the text. _When 
& asked:‘how detection of the confusion influenced her. reading of the passage 

Sebi ee and subsequent recall, she repoted: my made the description apply to one of 
| a “the kinds - of novels for myself but I didn’ t include my rationalisation in 

the answer." 

Another way. of dealing with the confusions Pd recall was 
deliberately omit aatieh of them. Several subjects who =e the 
inconsistency dn thie Wars passage made deliberate modifications in their 


napeotorels such that the inconsistent nature of Catherine’ 8 paknouie was not 


‘mentioned. One subject ‘reported: "I tried about: three times to make sense 


of it» I assumed the writer made a mistake. I SPRNEEQE SRS it to make sense © 


5 oe in recall." Even 4 the subjects who did mention the inkoninlerency in 
Catherine’s Dahaytor offen made subtle changes that helped explain a ‘For 
example, one eubject recalled: "Catherine wanted to allow for religious 

* freedom but this did not work. So: she plote€d . . o" When asked later 


about her understanding of this inconsistency, she wrote: "I figured she 


felt ‘the situation was getting too bad... I tried to make sense out of it . 


. s 
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and read more into it than was there, I guess." Three other subjects also 
indicated that Catherine tried to hold out against the nobles but finally 
- had to give in to their constant pressure. One of these gave the fotiowis 
account of her attempts to deal with the passage: "I tried to figure out 
vhat was going on, but I couldn’t. So when I answered the question, I made 
the information fit. The whole caeeee really didtased aa. 

In some situations, the lack of. prior knowledge bouts soph and the 
inability to draw clarifying inferences wii Motuaig facilitate confusion 
. detection. This was demonstrated in the Literature passage, which was 
poorly recalled and rated low in comprehensibility and familiarity, but had 
the highest detection rate. Most of the subjects bees something was wrong 
with the passage as they were: reading it, and they eciea but failed to | 


impose a coherent meaning upon it. , Four of them Later attributed their 


inadequate recall answers to the confusion: "T tried to figure out what the 


s x 


reference was to . « + woe cadead tip in answer;" "I tried but couldn’t decide 
what the withers was taking about. Maybe that’s why I couldn’t remember 
anything about this passage;" "I didn’t know haw to interpret it, so I just 
read on... It had an influence on not remembering as much about the 
seienia® "I felt as if I-mibsed a large part of understanding the article. 
I wasn’t able to remember all three types of novels probably because that 
part of the article didn’t make sense to me." 

All of these protocols demonstrate the problem solving béliavior that 
sesite engage in during reading. In their effort ‘towards undérstanding, 


they made inferences and assumptions, as well as selectively omitting or 
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" transforming information, to come up with a plausible inteecueeseien of the 
passage.. Many of the aubieeis did so without awareness, and only upon being - 
informed of the existence of a confusion did they detect one. Such was the 
case in the’ Inca passage, here ten subjects reported the confusion but only 
four noticed it during reading. Ta. contenant, Fivkusity all the subjects who 
reported an isdéddieventy in the Wars passage oe it during reading. In 
fact, two subjects even expressed their failure “to: understand in the recall 
protocols themselves. One subject wrote: "Cathering' believed in religious 
Srveioa: It also said she conspired with the nobility, which didn’t waka” 
sense to me." e other, after stating that Catherine first aapouead che ‘ 
Protestants then\sided with the Catholics, commented: "Story did not see 
clear here." Sinée the subjects did not know’ at the ihe of recall that 
confusions had been deliberatély included in the text, these comments . 
provide clear evidence of subprahentins monitoring during reading. 

The comprehension monitoring behaviors just discussed are essentially . ; - 
content-specific. That is, they deal with the prior eacwludga a reader can 
bring to bear on a particular sdewenk of text to render it more | 
comprehensible. Comprehension monitoring also involves more content-free 
behaviors and decisions. For example, a common tesponse upon firet 
encountering a confusion was to reread previously read information, checking 
to see if some crucial bit of information had been overlooked. Another 
 eeewtuas was to make a mental hes that a problem had occurred, but to 


| A 
continue reading in the hope that clarification would occur later in the 


_ text. wo subjects verbalized this type of response. One subject noticed 
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an inconsistency as he was reading and reported: "I figured there was a 
reason for it, that I would find out later." Another said: "I kept waiting 
for an explanation." Thus, the ‘subjects exhibited some faith in the writer 
to resolve the inconsistency at a subsequent point in the text. Ai though 
they noticed a problem, they continued reading to seek clarification. Since 
readers have a right to expect clarity from an author, such. behavior is an 
‘ant Ma comprehension monitoring strategy. The reader who becomes bogged 
. down in a confusing section of text that could have been clarified with © 
continued reading is technically’ a comprehension monitor, but is not 
employing an appropriate "fix-up" strategy. | 

Another component of comprehension monitoring involves setting a 
ere deciding when comprehension is adequate. The retrospective 
reports revealed that the subjects did make such decisions. | Some reported 
‘that they realized there was a problem but decided it was trivial and not 
worth the effort of trying to resolve. Others explained that they were _ 


reading for general ideas and so understood the main theme even if a 


single 
sentence seemed to be in conflict. For example, one subject who istaeed: cis 
ambiguity in the Literature passage was not terribly bothered by it: "It 
didn’t matter much. I did understand that eventually democracy was 
implemented." . 

Criterion explanations were also typical of subjects who did not notice 
the confusions during reading but detected them when informed of their 


’ presence. When subjects who reported an inconsistency in the Byzantine | 


passage after reading were asked why they thought they had not noticed it 
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unimportant. Iwas reading for general ideas." Another was: “Not too 
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initially, one subject wrote: "I ignored the first sentence thinking it was 


interested in art--just looking for general ideas." And another explained: 


"I understood the passage so the sentence didn’t really confuse me or enter 
my mind." This strategy of bondinn for general ideas can also account for 
failures to detect confusions altogether. 

The behavior of one particular subject is worth examining because it 
represents a processing strategy mature comprehenders are not sibpawad: te 
engage in. The subject did not detect the confusion in the Inca passage 
until iietvoctad to find it, and he offered this explanation for his fsiiuee 
to notice it initially: "The confusion was. obvious, but 1 read the material 
as individual sentences, not paragraphs, so I wasn’t hethered by it. It was 
just two separate pieces of information." The subject also failed to notice 
the Byzantine confusion until instructed to do so and explained: "I was just 
trying to collect facts. I didn’t put them. together.as.a whole." tad parece beet 
another cause of detection failure is reading sentence by sentence without | 
integration across sentences. Since all of the onntuaions required 


consideration of two or more sentences, integration was essential. This 


subject did reasonably well in answering the recall questions, however, 


showing that his low-level arnregy was sufficient for the explicit task 


\ 


demands. } f 
» Finally, the retrospective reports also revealed some ways of reacting 
to the confusions that were not oriented towards fixing up the difficulties 


in-comprehension. One of these was to attribute the confusion to an error 
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on the part of the author or typist and make no attempts to interpret it. 
For example, one subject’s reaction to the ambiguity in the Literature 
passage was: "I thought it was an omiasion, like maybe a sentence had been 


a 


left out. I just went on reading though." Another was for subjects to 


blame themselves for not understanding the confusing information. For 


example, a subject’s description of how she dealt with the Wars confusion 
was: "y merely interpreted it as correct bia assumed I had misread 
something previous." Perhaps the least adaptive eapoted or all was made by 
a subject reading the Wars passage who: “more or less got frustrated and 


just threw my hands up." 


Summa FY and and Conclusions 


The ren E atudy explored he comprehension monitoring abilities of 


‘ 


college students. Subjects read and ‘recalled texts containing intentionally 


Oe may che y ela ‘ “hts Ate , 5 iy 


introduced confusions. They were nib ewquentiy informed, of the existence of 
the confusions and were asked to report them. “Mditional questions, called_ 
for Jer cassaeeied reports on : chew the confusions affeeted comprehension. 
Three types of confusions were studied: Teansistent information, ‘ynclear 
references, .and inappropriate connectives. The confusions involved either 
the main idea or a detail of the target paragraph.» A control group read and 
recalled the passages in their "nonconfusing" versions. ' All subjects also 
rated the comprehensibility and femiliarity of each pausegs: 


The study provided several results of interest: 1. eiuteeea failed to 


report a sur Abie dee te large proportion of the confusions (62%), and less 


' than one quarter’ of ‘the confusions were reported noticed during reading. .As 
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expected, however, main idea problems were more noticeable than detail 
problems. In addition, subjects were more successful at detecting 

; inconsistencies and vague referents Sian inappropriate connectives. In 

- fact, connective eohineline were often classified as ijconsieteuctens This 
latter outcome warrants further foveetiserton, since it is nat clear whether 
connectives hag so little salience that subjects simply ignored them or that 


they had so much salience that they carried the interpretation of the 


~-sentence. 


2. The presence of a confusion did aot significantly decrease the 
pigeain of information recalled from the hecak watageudl, though there was a 
trend in this direction. Subjecta retrospectively Seonstad-tink they 
sometimes deliberately omitted or transformed information that .was 


confusing, and they also felt that the confusions sometimes impaired their 


= 


_memory for the material. These findings demonstrate that recall measures 4 
_ alone often do not’provide sufficient information about how well subjects 
comprehended text, since most subjects were’ selective in what they included 
in their anawers. 

3. The EXE aenEe of a confusion did jae reduce the overall 
éomptchensibality rating of a passage, nor did familiarity ratings differ 
between the seeecinentel and control grdups. 
‘: There were no sigsttrnent correlations among any of the dependent 


variables, though there were small positive correlations between the 


comprehensibility and familiarity ratings and between recall and detection. 
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5. The retrospective reports and inferences drawn from the recall 


protocols reveal the variety of ways readers can impose sense on potentially 
confusing ieevawbhit, This indicates that failure to report a confusion is 
not in itself a sensitive index of comprehension monitoring, since subjects 
often made inferences to resolve the confusions without realizing they had 
done so. Moreover, their purposes for reading were not givies compatible 
with the implicit task demand of confusion detection; e.g., they were 
reading for general understanding. Clearly, it is not enough to know 
whether or not a confusion was detected; one must also know how the 
iabotuaticn had been interpreted and how eekenaively Le snad teen processed. 
The sophistication with which skilled readers approach the task of 
comprehending can be a serious pitfall in the study of comprehension 
monitoring. The spontaneous use of fix-up procedures may lead to a 
spuriously low estimate of comprehension monitoring, but this same behavior 
may lead readers to feel they understand when in fact they do not. 

In conclusion, the study has shown that college students can and do 
monitor their comprehension, though not always consistently. if they 
experience difficulty in understanding, they hive a variety of procedures 
. available to assist them in coming up with a plausible interpretation of the 
text. Moreover, these procedures are sometimes applied so automatically 
that readers are unaware that their interpretation of the text may not be 
the one the author intended to convey. Finally, there are large individual 
differences in the way peciece monitor their comprehension. Thus, it 


appears that the question of interest in further investigations is not 
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whether readers monitor their comprehension, but rather how they monitor it. 
It remains to be determined whether skilled readers monitor their 
comprehension more effectively than less skilled readers. 

One educational implication of the study is based on the finding that 
many subjects who did not notice the confusions during reading were able to 
detect them when specifically instructed eee ‘This suggests that 
although many students are capable of comprehension monitoring, they do not 
* always do it on their own initiative. This lack of motivation for careful 
reading may stem from.exposure to poorly written material and an 
unquestioning beltef in the printed word that is reinforced by teachers who 
treat the assigned textbook as the source of the "right" answer. One 
additional factor is that understanding is often: monitored by scccionel: 
agente rather than by the students themselves. Schallert and Kleiman (1979) 
and Wertsch (1978) report that teachers asbins much of the responsibility of 
cognitive monitoring for children, keeping track of. what_they_know_and_do 
nat an, what they understand and do not understand, and in other ways 
guiding them through the attainment of some goal. Even when students reach 
high school and college, much of the burden of comprehension monitoring is 
absent. For example, students engaged in computer managed instruction (CML) 
do not have to ask themselves if they understand the material; the computer 
iotoved the students during each encounter vhether or. not they understand 
(anderson, in press). ‘Similarly, programmed instruction (PI) textbooks 


eliminate the need for self-questioning by guiding students step-by-step 


through the learning. process. 
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‘There are both advantages and disadvantages to this educational 
practice of monitoring students’ comprehension for them. On the one hand, 
it ensures that students understand the material by keeping a careful check 
on their understanding and providing appropriate measures for clarifying’ 
comprehension failures. On the other hand, it may foster passive reading 
and study habits: Why should students make the effort of ehnoking their 
understanding when someone else will do it for them? In fact, the 
programmed techniques were originally developed because many students -did 
- not do well with traditional textbook-lecture formats. Perhaps this could 


have been avoided had the students learned efficient comprehension 


MOT ' 


monitoring strategies when they were younger. : Pe “ 
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lie was discovered after the eriment was conducted that the . Ff 
distinction between main-point and detail confusions does not hold for 


‘ the inappropriate connectives passages. a | 
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Table 1 


Target ‘Paragraphs and Probe Guieeiet ons 


Inconsistencies 
Main Point: The Empire of the Inca 


The Inca economy was extremely backward (advanced)® for 


its time. The chief occupation and source of income was 
farming. . Farming methods were quite sophisticated and included 
scientific irrigation, fertilization, and use of terraces. 
Agricultural products were therefore plentiful and of good 
‘ quality. A fundgmental requirement of the gevernment was 
that every able-bodied subject must pay taxes. These taxes 
were paid through labor rather than through a tedium of | 


exchange. As a result, unemployment was virtually absent. | 


Question: Describe and evaluate the economy of the Inca Indians. 
Detail: Great Renaissance Artists 


Another great artist, Leonardo da Vinci, is, perhaps, 

_ the supreme example of the "universal human" of the Renaissance. 
He was proficient 4n painting, sculpture, architecture, 
engineering, anatomy, physiology, botany, and mathematics. 
Within hig’ notebooks can be found sketches of flying machines 
and wat machines--including a tank and a parachute--as well 


as accurate drawings on anatomy and optics. These sketches 


_~ lacked any (had great) future practicality but (and) have 
a become well-known to many people. His notebooks, as well a 


y 


as many of his paintings, have been displayed in art museums 
around the world. 
Question: Describe and evaluate da Vinci's contribution as a Renaissance 


\ artist. 
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Table 1 Cont'd 


Unclear iebetencee 
Main Point; Literature of the Spanish Renaissance 
Three types of novels surfaced at this eine namely. the 

chivalry novel, the picaresque novel, and the pastoral novel. 
But only one type (the pastoral) had any significant impact 
upon Spanish cultyre. It would typically describe idealistic 
and highly imaginative regions, while including love plots 
that were often complicated. The first was La Diana which 
was published in 1559 by Jorge de Montemayor. “ Although more 
were published, La Diana is considered by seni to represent 


the best of those that appeared. 


Question: Identify the three types of novels and the impadt of this 


‘form of literature on Spanish culture. 


ee 


Detail: ., Political Development of Ancient Greece 
There were three types of early political rule in Greece. 


The first major rulers were monarchs, who succeeded to the 
throne on the basis of heredity. The kings claimed™hey 
were descended from ane gods, but their authority was not 
absolute. , The next rulers were aristocrats, who set up. 
oligarchies (rule of the few). The nobles gained control : 
of the good land, and the common people were generally 
‘left out of political participation. ‘The oligarchies were 
replaced by tyrants, who gained their power by force. 
Although these rulers were dictators, they were often 
benevolent. ‘They gained popularity when they took up the 
cause of the poor and underprivileged. By breaking their 
(the aristocrats’) hold, the (the tyrants) paved the 


way for the appearance of democracy. 


Question: Identify and describe the phases of early political rule 
in Greece. 
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Table 1 Cont'd 


Inappropriate Connective ' 
Main Point: Byzantine Civilization *s 


Byzantine culture was largely modeled after the Greeks. 


Therefore, (However,) the Byzantines developed a unique 


= style of architecture which greatly influenced Europe and 
““‘the Near East. The Orthodox Churches were the best expres- 
sions of the Byzantine style, and were distinguished by 
majegtic vaults and domes. The interiors of the churches 
ee with mosaics and frescoes. The church of 
Hagia Sophia in Constantinople is the masterpiece of 
Byzantine architecture. Its most impressive feature is its 
huge 100-foot diameter dome with 40 windows. 
Question: Describe and oatiake ynene eee architecture. : 
Detail: French Religious Wars 


Severe persecution of the French Protestants began during 
the reign-of Henry II. After his death, Catherine de Medici, 

his wife, ruled as regent in place of: their ten year old 
son. Catherine soon established a policy to efcourage free 
exercise of all religion. In spite of the efforts to affirm 
freedom of worship for the Huguenots, the nobility continued 
to persecute the Protestants. Ti 1572, the Guise family 
plotted to nirder the Huguenot leaders who were fo gather 
at a religious rally in Paris. In spite of continued and 
extensive pressure such as this, Catherine steadfastly sup- 
ported religious freedom for the Protestants. Therefore, 

» (However ,) she_conspired with the Guise family in planning 
this attack which would come to be known as the St. 


Bartholomew Massacre. 
‘Question: Describe Catherine da Medici's relationship with the MUEEOOER 
and the French nobility. 


- 8YJords in saewnthosae appeared in consistent versions of the paragraphs. 
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Table 2 
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Proportion of Subjects Detecting Intended Confusions | 


x 


Intended Confusions Total Daring 
Reading 
Inconsistencies 
Main Point (Incas) 71 29 
Detail (Artists) 21 07 
Ambiguous . References 
Main Point (Literature) 093 edd 
Detail (Greeks) 14 14 
Inappropriate Connectives® 
Main Point (Byzantine) .21 .00 
’ Detail (Wars) 07 07 


Note. ne 14 


a1¢ inconsistency detections (see p. 13) are 
included, the figures for the Main Point passage 
are ;50 for total and .14 for during reading. The 
detail figures are .79 and .71. 
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Table 3 
Proportion of Target-Relevant Recall Responses 
+ % 
Intended Confusions ~Experimental _Conpgol : ye 
: Inconsistency - 
Main Point (Incas) .64 ; 1.00 
ee ae , , 
Detait* (Artists) rey te” gl -13 = 
Ambiguous Reference 
Main Point (Literature) .21 25 
‘Detail (Greeks) .36 .50 
Inappropriate Connective 
Main Point (Byzantine) 36 «50 
Detail (Wars) ar 1.00 
Note. n= 14 for experimental group, n = 8 for 
control group. 
ak 
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Table 4 


Mean Comprehensibility and Familiarity Ratings 


6 


oO  T—-'+ =O — kw —  — —— 


a Comprehensibility : Familiarity 
Experimental Control Experimental Control 
Incas 3.79 4.13 eer 2.50 | 
| 
Artists 3.50 3.71 2.79 2.38 
Literature | 2.82 2.31 1.50 1.25. 
Greeks 3.50 4.15 2.89 ‘ 3.50 
Byzantines 3.04 3.38 1.93 1.88 
Wars 2.93 4.25 1.68 2.25 
Overall. 3.26 3.65 2.23 2.29 | 
* 
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Table 5 " 


Correlation Matrix 


Rated 


Comprehensibility Familiarity Recall Detection 
| : Rated 
Comprehensibility 1.00 
Rated | 
Familiarity .32 1.00 
Recall -.06 05, 1.00 


Detection -.02 04 23 1.00 


Note. An r of .514 is required for p < .05. 
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Appendix A 


Instructions to Subjects in Comprehension Experiment 


The first section of this booklet contains six short passages about 
world history topics. You should read each passage davetully, as though “a 
you were studying for a test. You may read each passage as many times 
as you wish before going on to the next one, You may underline or mark 
the passages as you read. However, please read the passages in the order 
in which they are presented in the booklet and DO NOT look on toa 
previously read passage. . 

The second section of the booklet contains six "discussion" questions-- 
one for each passage you read. Please answer each question as fully and 
in as much detail as you can. Please use Stud wadtanons in your 
answers. Again, be sure to answer the questions in ie cede they appear 
in your booklet and DO NOT look back at the original passages. 

The third section of the booklet contains questions about your com- . 
prehension of the passages that you read. More thorough inetructions will 

‘be provided when you reach this point in the experiment. 

If you have any questions now, or at any time during the experiment, 
raise your hand and the experimenter will assist you. You may take as 
much time as you need for any part of the iaver tae, and you may leave 


when you are through. 
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Instructions for Section 2 


This section.of the booklet contains six discussion questions--one 


for each passage you just read, 
Answer each question fully and with as much detail as you can. Please 
use complete sentences in your answers. 


Please answer all questions in the order in which they appear. 
] DO NOT LOOK BACK AT THE PASSAGES 
Instructions for Section 3 


Some of you may have noticed misleading or contradictory information 
in the passages that you read. Each of the six passages contained one such 
confusion, which was always located in the middle paragraph. These con- 
fusions were deliberately introduced into the passages in an attempt to 
discover whether they affect students’ comprehension and memory of text. 

‘Don't feel badly if you did not notice the confusions during reading--they 
are quite subtle and most pacoie fail to detect them unless they are 
specifically looking for them. 

There were three types of confusions included in the passages. One 
type involves the use of a pronoun to refer to a previously discussed oe 
In some situations, the pronoun could refer to two or more. nouns, and the 
meaning of the sentence cannot be fully understood unless you know whitch 
noun is being referred to. A second type of confusion involves the res> 
ence of contradictory information. A particular sentence may express an 


idea, and a subsequent sentence may present an idea that directly or 


SP | 
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indirectly contesdicts 1€: A third type. of eer wvelven expectations 
that are built up about: the kind of information that will follow a partic- 
ular conjunction. For example, if iia encounter the word "however," you 
expect that it will be followed by Sitoraittnn which somehow contrasts or 
modifies previous information. You would be surprised if the aie Haan” 
tion stupiy supplemented previously stated ideas. 

This final section of the booklet contains six questionnaires celated:. 
to the six passages you have read. Please answer the questions for each 
passage as accurately as possible. The title of each appears at the top 


- 


of each questionnaire~ 


cr 
bo 
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Appendix B 


Questions for Section 3 


Questionnaire for (Passage Title) 
#1 A. Without looking back at the passage, do you think you know what 


“the confusion was? If YES--describe it here. 


If NO--go back to the passage (same colored sheet as this page) 
and try to find it. Remember, the confusion is in the middle 


paragraph. If you can find it, describe it here. 


é 


If -you failed to find the confusion, after a thorough search, 


please skip to question #3. 


B. Which category does the confusion fall into--pronoun, contra- 


diction, or conjunction? 


Cc. Does the. confusion involve a MAIN POINT or a DETAIL of the 


paragraph? 
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#2. Did you notice the confusion during your initial reading? If YES, 


go to part A (this page), if NO, go to part B (next page). 


A. ‘If YES--did you attempt to make sense of it? Did you attribute 
the confusion to an error on the part of the writer? How :did 


the confusion influence the way you read the rest of the passage? 


Please answer in detail. : 


® Pe 


How did you deal’ with the confusion when you answered the discussion 


question in Section 3? (e.g., Did you include the confusing information 


Fue 


even though you knew something. wasivtong + with it? Did you deliberately 


omit mention of it? pid you trangioes the confusing information so 


that it made sense? Did you ahs hae to ietiae 4t in your, answer?) 


4 
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If NO--try to explain why you think you did not detect it, 


(e.g., Was the confusion too subtle? Was tt 80 trivial that 
it didn't affect your overall understanding of the passage? 
Were you reading the passage for general ideas rather than 


; ; 
going over it word for word?) 


» | md 


#3 On a scale of 1-5, rate your FAMILIARITY with the ideas Presented 


in the passage. 


» Not at All ~ ro ~ Very 
Familiar | : Familiar 


< é 
Do you think that your prior knowledge of ‘the topic influenced your 
understanding of the passage? In particular, did it make it easter 


(or more difficult) to detect the confusion? 


CENTER FOR THE STUDY OF READING 


READING EDUCATION REPORTS 


No. 1: Durkin, 0. Comprehension instruction—Where are You?, October 1977. (ERIC Document Repro- 
duction Service No. ED 146 566, 14p., PC-$1.82, MF-$.83) : 

No. 2: Asher, S.R. Sex Differences in Reading Achievement, October 1977. (ERIC Document Reproduc: - 

» tion Service-No. ED 145 567, 30p., PC-$3.32, MF-$.83) 

No. 3: Adams, M: J, Anderson, R.C., & Durkin, 0. Beginning Reading: “Tincey and Practica Nowbrriber 
1977. (ERIC Document Reproduction Service No. ED 151 722, 15p., PC-$1.82, MF-$.83) 

No. 4: Jenkins, J.R., & Pany, 0. Teaching ‘Reading Comprehension in the Middle Grades, January 1978. 
(ERIC Document Reproduction Service No. ED 151 756, 36p., PC-$3.32, MF-$.83) : 

No. 5: Bruce, B. What Makes a Good Story?, June 1978 (ERIC Document Reproduction Service No. 
ED 158 222, 16p,, PC-$1.82, MF-$.83) 

No. 6: Anderson, T.H. Another Look at the Self-Questioning Study Technique, September 1978. (ERIC 

Document Reproduction Service No. ED 163 441, 19p., PC-$1.82, MF-$.83) 

No. 7: Pearson, P. D., & Kamil,M.L. Basic Processes and. instructional Practices in Teaching Reading, 
December 1978 (ERIC Document Reproduction Service No. ED 165 118, 29p., PC-$3.32, MF- $.83) 

No. 8: Collins, A, & Haviland, S. E. Children's Reading P; s, June 1979. : 

No. 9: Schallert, 0. L, & Kleiman, G.M. Some Reasons y Teachers are Easier to Understand than 
Textbooks, June 1979. 

No. 10: Baker, L Do | Uriderstand or Do I not Understand: That is the Question, July 1979. 

No. 11: Anderson, R. C., & Freebody, P. Vocabulary Knowledge and Reading, August 1979, 


*:, 


_ CENTER FOR THE STUDY OF READING 
- TECHNICAL REPORTS 


No. 1: Halff, H.M. Graphical Evaluation of Hierarchical Clustering Schemes, October 1975. (ERIC Docu- 
ment Reproduction Service No. ED 134 926, 11p., PC-$1.82, MF-$.83) 

No. 2: Spiro, R. J. Inferential Reconstruction in Memory for Connected Discourse, October 1975, (ERIC 
Document Reproduction Service No. ED 136 187, 81p.,, PC-$6.32, MF-$.83) 

No. 3: Goetz, £. T. Sentences in Lists and iri Connected Discourse, November 1975. (ERIC Document 
Reproduction Service No. ED 134 927, 75p., PC-$4.82, MF-$.83) 

No. 4: Alessi, S. M., Anderson, T. H. & Biddle, W. B. Hardware and Software Considerations in Computer 
Based Course Management, November 1975. (ERIC Document Reproduction Service No. ED 134 928, ° 
2)p., PC-$1.82, MF-$.83) - 

No. 5: Schallert, D. L improving Memory for Prose: The Relationship between Depth of Processing and 
Context, November 1975: (ERIC Document Reproduction Service No. ED 134 929, 37p., PC-$3.32, MF- 
$.83) 

No. 6: Anderson, R. C., fiiaie E. T., Pichert, JW, & Halff,H.M. Two Faces of the Conceptual Peg 
Hypothesis, January 1976. (ERIC Document Reproduction Service No. ED 134 930, 29p., eee 
MF-$.83) ° t 

No. 7: Ortony, A. Names, Descriptions, and Pragmatics, February 1976. (ERIC Document Reproduction 
Service No. ED 134 931, 25p., PC-$1.82, MF-$.83) 

No. 8: Mason, J.M. Questioning the Notion of Independent Processing Stages in Reading, February 
1976. (Journal of Educational Psychology, 1977, 69, 288-297) ; 

No. 9: Siegel, M.A. Teacher Behaviors and Curriculum. Packages: Implications for Research and 
Teacher Education, April 1976. (ERIC Document Reproduction Service No. ED 134 932, 42p,, PC- 
$3.32, MF-$.83) 

No. 10: Anderson: R. C., Pichert, J. W., Goetz, E. T., ‘Schallert, D. L, Stevens, K.C.,, & Trollip, S. R. Instantia- 
tion of General Terms, March 1976. (ERIC Document Reproduction Service No. ED 134 933, 30p., PC- 
$3.32, MF-$.83) 

No. 11: Armbruster, B. B. Learning Principles from Prose: A Cognitive “Approach Based on Schema 

- Theory, July 1976. (ERIC Document Reproduction Service No. ED 134 934, 48p, PC-$3.32, MF-$.83) 

No. 12: Anderson, R.C.. Reynolds, R. E., Schallert, D. L; & Goetz, £.T. Frameworks for Corhprehending 
‘Discourse, July 1976. (ERIC Document Reproduction Service No. ED 134 935, 33p., PC-$3.32, MF-$.83) 

No. 13: Rubin, A.D. Bruce, B.C., & Brown, J. S. A Process-Oriented Language for Describing Aspects of 
Reading Comprehension, November 1976. (ERIC Document Reproduction Service No. ED 136 188, 
41p., PC-$3.32, MF-$.83) - 

No. 14: Pichert, J..W., & Anderson, R.C. Taking Different Perspectives on a Story, November 1976. 
(ERIC Document Reproduction Service No. ED 134 936, 30p.. PC-$3.32, MF-$.83) 

No. 15: Schwartz, R.M Strategic Processes in Beginning Reading, November 1976. (ERIC Document 
Reproduction Service No. ED 134 937, 19p., PC-$1.82, MF-$.83) 

No. 16: Jenkins, J. R, & Pany, D. Curriculum Biases in Reading Achievement Tests, November 1976. 
(ERIC Document Reproduction Service No. ED 134 938, 24p., PC-$1.82, MF-$.83) 

No. 17: Asher, SR, Hymel,S, & Wigfield, A| Children's Comprehension of High- and Low-interest 
Material and a Comparison of Two Cloze Scoring Methods, November 1976. (ERIC Document Repro- 
duction Service No. ED 134 939, 32p., PC-$3.32, MF-$83) 

No. 18: Brown, AL, Smiley, SS. Day, J. D., Townsend, M. AR, & Lawton, S.C. Intrusion of a Thematic 
idea in Children's Comprehension and Retention of Stories, December 1976. (ERIC Document Repro- 
duction Service No. ED 136 189, 39p., PC-$3.32, MF-$.83) 

No. 19: Kleiman, G.M. The Prelinguistic Cognitive Basis of Children's Communicative Intentions, Febru- 

ry 1977. (ERIC Document Reproduction Service No. ED 134 940, 51p.. PC-$4.82, MF-$.83) 
. 20: Klewnan,G.M. The Effect of Previous Context on Reading Individual Words, February 1977 
(ERIC Document Reproduction Service No. ED 134 941, 76p., PC-$6.32, MF-$.83) 
No- 21-—Kane--J-+., & Anderson-R.C— Depth of Processing and interference Effects in the Learning end 
of Sentences, February 1977. (ERIC Document Reproduction Service No. ED 134 942, 
29p, PC-$3.32, MF-$.83) 


07 


No. 22: Brown, AL, & Campione, J.C. Memory Strategies in Learning: Training Children to Study Stra- 
a , March 1977. (ERIC Document Reproduction Service No. ED 136 234, 54p, PC-$4.82, MF- 

No. 23: Smiley, S.S. Oakley, D. D., Worthen, D., Campione, J.C. & Brown,A L Recall of Thematically 
Relevant Material by Adolescent Good and Poor Readers as a Function of Written Versus Oral 
ae a March 1977. (ERIC Document Reproduction Service No. ED 136 235, 23p., PC-$1.82, 
MF$..83; 

No. 24: Anderson, R. C., Spiro, R. J, & Anderson, M.C. Schemata as Scaffolding for the Representation 
of Information in Connected Discourse, March 1977. (ERIC Document Reproduction Service No. 
ED 136 236, 18p., PC-$1.82, MF-$.83) 

No. 25: Pany, 0, & Jenkins, J.R. Learning Word Meanings: A Comparison of Instructional Procedures 
and Effects on Measures of Reading Comprehension with Learning Disabled Students, March 1977. 
(ERIC Document Reproduction Service No. ED 136 237, 34p.,, PC-$3.32, MF-$.83) 

No. 26: Armbruster, B. B., Stevens, R. J. & Rosenshine, B. Analyzing Content Coverage and Emphasis: A 
Study of Three Curricula and Two Tests, March 1977. (ERIC Document Reproduction Service No* 
ED 136 238, 22p., PC-$1.82, MF-$.83) 

No. 27: Ortony, A, Reynolds, R. E., & Arter, J. A Metaphor: Theoretical and Empirical Research, March 
1977. (ERIC Document Reproduction Service No. ED 137 752, 63p., PC-$4.82, MF-$.83) 

No. 28: Ortony, A. Remembering and Understanding Jabberwocky and Small-Talk, March 1977. (ERIC 
Document Reproduction Service No. ED 137 753, 36p., PC-$3.32, MF-$.83) 

No. 29: Schallert, D. L, Kleiman, G. M., & Rubin, AO. Analysis of Differences between Oral and Written 
Language, April 1977. (ERIC Document Reproduction Service No. ED 144 038, 33p., PC-$3.32, MF- 

No. 30: Goetz, ET, & Osborn, J. Procedures for Sampling Texts and Tasks in Kindergarten through 
Eighth Grade, April 1977. (ERIC Document Reproduction Service No. ED 146 565, 80p., PC-$6.32, MF- 
$.83) ' 

No. 31: Nash-Webber, B. Anaphora: A Cross-Disciplinary Survey, April 1977. (ERIC Document Reproduc- 
tion Service No, ED 144 039, 43p., PC-$3.32, MF-$.83) 

No. 32: Adams, M. J.. & Collins, A A Schema-Theoretic View of Reading Comprehension, April aoe: 
(ERIC Document Reproduction Service No. ED 142:971, 49p., PC-$3.32, MF-$.83) 

No. 33: Huggins, A W. F. Syntactic Aspects: of Reading Comprehension, April 1977. (ERIC Dodiirnient 
Reproduction Service No. ED 142 972, 68p., PC-$4.82, MF-$.83) 

No. 34: Bruce, B.C. Plans and Social Actions, April 1977. (ERIC Document Reproductien Service No. 
ED 149 328, 45p.. PC-$3.32, MF-$.83) 

No. 35: Rubin, A 0. Comprehension Processes in Oral and Written Language, April 1977. (ERIC Docu- 
ment Reproduction Service No. ED 150 550, 61p., PC-$4.82, M>-$.83) 

No. 36: Nash-Webber, B., & Reiter, R. Anaphora and Logical Form: On Formal Meaning Representation 
for Natural Language, April 1977. (ERIC Document Reproduction Service No. ED 142 973, 42p., PC- 
$3.32, MF-$83) 

No. 37: Adams, M. J. Failures to Comprehend and Levels of Processing in Reading, April 1977. (ERIC 
Document Reproduction Service No. ED 145 410, 51p., PC-$4.82, MF-$.83) 

No. 38: Woods, W.A Multiple Theory Formation in High-Level Perception, April 1977. (ERIC Document 
Reproduction Service No. ED 144 020, 58p., PC-$4.82, MF-$.83) 

No. 40: Collins, A, Brown, J. S. & Larkin, KM. Inference in Text Understanding, December 1977. (ERIC 
Document Reproduction Service No. ED 150 547, 48p.,, PC-$3.32, MF-$.83) 

No. 41: Anderson, R. C. & Pichert, J. W. Recall of Previously Unrecallable information Following a Shift 
in Perspective, April 1977. (ERIC Document Reproduction Service No. ED 142 974, 37p., PC-$3.32, 
MF-$.83) 

No. 42° Mason, J. Osborn, J, & Rosenshine, B. A Consideration of Skill Hierarchy Approaches to the 
Teaching of Reading, December 1977. (ERIC Document Reproduction Service No. ED 150 549, 176p., . 
PC-$12.32, MF-$.83) 

No. 43: Collins, A, Brown, A L, Morgan, J. L, & Brewer, W. F. The Analysis of Reading Tasks and Texts, 
April 1977. (ERIC Document Reproduction Service No. ED 145 404, 96p., PC-$6.32, MF-$.83) 

No. 44: McClure, £. Aspects of Code-Switching in the Discourse of Bilingual Mexican-American Children, 
April 1977. (ERIC Document Reproduction Service No. ED 142 975, 38p., PC-$3.32, MF-$.83) 

No. 45: Schwartz,R. M Relation of Context Utilization and Orthographic Automaticity in Word Identifi- 
cation, May 1977. (ERIC Document Reproduction Service No. ED 137 762, 27p, PC-$3.32, MF-$83) 


28 


wv 


No. 46: Anderson, R.C, Stevens, K.C., Shifrin, Z, & Osborn, J. aan of Word Meanings in Chil- 
dren, May 1977. (ERIC Document Reproduction Service No. ED 142-976, 22p.,, PC-$1.82, MF-$.83) 

No. 47: Brown, A.L. Knowing When, Where, and How to Remember: A Problem of Metacognition, June 
1977. (ERIC Document Reproduction Service No. EO 146 562, 152p., PC-$10.82, MF-$.83) 

No. 48: Brown, AL, & DeLoacfie, J.S. Skills, Plans, and Self-Regulation, July 1977. (ERIC Document 
Reproduction. Service No. ED 144 040, 66p., PC-$4.82, MF-$.83) 

No. 49: Goetz, £. 7. Inferences in the Comprehension of and Memory for Text, July 1977. (ERIC Docu- 
ment Reproduction Service No. ED 150 548, 97p., PC-$6,32, MF-$.83) . 

No. 50: Anderson, R.C. Schema-Directed Processes in Language Comprehension, July 1977. (ERIC 
Document Reproduction Service No. ED 142 977, 33p., PC-$3.32, MF-$.83) 

No. 51: Brown,,A.L. Theories of Memory and the Problems of Development: Activity, Growth, and 
Knowledge, July 1977. (ERIC Document Reproduction Service No. ED 144 041, -59p, PC-$4.82, MF- 
$.83) 

No. 52: Morgan, J.-L. Two Types of Convention in Indirect Speech Acts, July 1977. (ERIC Document 
Reproduction Service No. ED 145 405, 40p,, RC-$3.32, MF-$.83) 

No. 53 Brown, AL, Smiley, S. S. & Lawton, S.C. The Effects of Experience on the Selection of Suitable 
Retrieval Cues for Studying from Prose Passages, July 1977. (ERIC Document Reproduction Service 
No. ED 144 042, 30p., PC-$3.32, MF-$.83) 

No. 54: Fleisher, LS, & Jenkins, J. R. Effects of Contextualized and Decontextuali%ed Practice Condi: 
tions on Word Recognition, July 1977. (ERIC Document Reproduction Service No. ED 144 043, 37p., 
PC-$3.32, MF-$.83) 

No. 55. Jenkins, J. R., & Larson, K. Evaluating Error Correction Procedures for Oral Reading, June 1978. 
(ERIC Document Reproduction Service No. ED 158 224, 34p., PC-$3.32, MF-$.83) 

No. 56. Anderson, T. H., Standiford, S. N., & Alessi, S.M. Computer Assisted Problem Solving in an intro- 
ductory Statistics Course, August 1977. (ERIC Document Reproduction Service No. ED 146 563, 26p., 
PC-$3.32, MF-$.83) 

No. 57: Barnitz, J. Interrelationship of Orthography and Phonblopical Structure in Learning to Read, 
August 1977. (ERIC Document Reproduction Service No. ED 150 546, 62p., PC-$4.82, MF-$.83) 

No. 58: Mason, J. M. The Role of Strategy in Reading in the Mentally Retarded, September 1977. (ERIC 

_ Document Reproduction Service No. ED 145 406, 28p., PC-$3.32, MF-$.83) 

No. 59: Mason, J. M. Reading Readiness: A Definition and Skills Hierarchy from Preschoolers’ Develop- 
ing Conceptions of Print, September 1977. (ERIC Document Reproduction Service No. ED 145 403, 
57p.. PC-$4.82, MF-$83) 

No. 60° Spiro, R. J. & Esposito, J. J. “Superficial Processing of Explicit inferences in Text, December 
1977. (ERIC Document Reproduction Service No. ED 150 545, 27p., PC-$3.32, MF-$.83) 

No. 65: Brewer, W. F. Memory for the Pragmatic.lmplications of Sentences, October 1977. (KRIG Docu- 
ment Reproduction Service No. ED 146 564, 27p,, PC-$3.32, MF-$.83) 

No. 66: Brown. A L, & Smiley, S.S. The Development of Strategies for Study Prose Passages, October 
1977. (ERIC Document Reproduction Service No. ED 145 371, 59p., PC-$4.82, MF-$.83) 

No. 68: Stein, N.L, & Nezworski, T. The Effects of Organization and Instructiona/ Set on Story Memory, 
January 1978. (ERIC Document Reproduction Service Ne_ED 149 327, 41p., PC-$3.32, MF-$.83) 

No. 69: Stein, NL. How Children Understand Stories: A Developmental Analysis, March 1978 (ERIC 
Document Reproduction Service No. ED 153 205, 68p., PC-$4.82, MF-$.83) 

No. 76: Thieman, T. J. & Brown, AL The Effects of Semantic and Formal Similarity on “Recognition 

for Sentences in Children, November 1977. (ERIC Document Reproduction Service No. 
ED 150 551, 26p.. PC-$3 32, MF-$.83) 

No. 77: Nash-Webber, B.L Inferences in an Approach to Discourse’ Anaphora, January 1978. (ERIC 
Document Reproduction Service No. ED 150 552, 30p., PC-$3.32, MF-$.83) 

No. 78 Gentner.D. On Relational Meaning: The Acquisition of Verb Meaning, December 1977. (ERIC 
Document Reproduction Service No. ED 149 325, 46p., PC-$3.32, MF-$.83) 

No. 79 Royer, JM. Theories of Learning Transfer, January 1978. (ERIC Document Reproduction Service 
No. ED 149 326, 55p., PC-$4 82, MF-$83) 

No. 80: Arter. J A. & Jenkins. J. R. Differential Diagnosis-Prescriptive Teaching: A Critical Appraisal 
January 1978 (ERIC Document Reproduction Service No. ED 150 578, 104p., PC-$7.82. MF-$.83) 

No 81. Shoben, E J. Choosing a Model of Sentence Picture Comparisons: A Reply to Catlin and Jones, 
February 1978 (ERIC Document Reproduction Sermce No. ED 150 577, 30p. PC-$3.32, MF-$.83) 


29 


No. 82: Steffensen, M.S. Bereiter and Engelmann Reconsidered: The Evidence from Children Acquiring 

Black English Vernacular,March 1978. (ERIC Document Reproduction Service No. ED 153 204, 3lp., 
PC-$3.32, MF-$.83) 

No. 83: Reynolds, R. E., Standiford, S.N., & Anderson, R.C. Distribution of Reading Time When Questions 
are Asked about a Restricted Category of Text Information, April 1978. (ERIC Document Reproduc- 
tion Service No. ED 153 206, 34p., PC-$3.32, MF-$.83) 

No. 84: Baker, Processing Temporal Relationships in Simple Stories: Effects of Input Sequence, April 
1978. (ERIC Document Reproduction Service No. ED 157 016, 54p., PC-$4.82, MF-$.83) 

No. 85: Mason, J. M, Knisely, £, & Kendall, J. Effects of Polysemous Words on Sentence Comprehen- 
sion, May 1978. (ERIC Document Reproduction Service No. ED 157 015, 34p., PC-$3.32, MF-$.83) 

No. 86: Anderson, T.H., Wardrop, J. L, Hively W., Muller, K.E., Anderson, R.1, Hastings,C.N, & 
Fredericksen, J. Development and Trial of a Model for Developing Domain Referenced Tests of 
Reading Comprehension, May 1978, (ERIC Document Reproduction Service No. ED 157 036, 69p., 
PC-$4.82, MF-$.83) ; 

No. 87: Andre, M. E.D. A, & Anderson, 1 H. The Development and Evaluation of a Self-Questioning 
Study Technique, June 1978. (ERIC Document Reproduction Service No. ED 157 037, 37p., PC-$3.32, 
MF-$,83) 

No. 88: Bruce, B.C., & Newman, D. Interacting Plans, June 1978. (ERIC Document Reproduction Service 
No. ED 157 038, 100p., PC-$6.32, MF-$.83) 

No. 89: Bruce, B. C., Collins, A, Rubin, A. 0., & Gentner, D. A Cognitive Science Approach to Writing, June 
1978. (ERIC Document Reproduction Service No. ED 157 039, 57p., PC-$4.82, MF-$.83) - 

No. 90: Asher, S.R. Referential Communication, June 1978 (ERIC Document Reproduction Service No. 
ED 159 597, 71p., PC-$4.82, MF-$.83) 

No. 91: Royer, J. M, & Cunningham, D. J. On the Theory and Measurement of Reading Comprehension, 
June 1978. (ERIC-Document Reproduction Service No. ED 157 040, 63p., PC-$4.82, MF-$.83) 

No. 92: Mason, J. M., Kendall, J. R. Facilitating Reading Comprehension Through Text Structure Manipu- 
lation, June 1978. {ERIC Document Reproduction Service No. ED 157 041, 36p., PC-$3.32, MF-$.83) 

No. 93: Ortony, A, Schallert, D.L, Reynolds, R.E., & Antos, S.J. Interpreting Metaphors and Idioms: 
Some Effects of Context on Comprehension, July 1978. (ERIC Document Reproduction Service No. 
ED 157 042, 41p., PC-$3.32, MF-$.83) 

No. 94: Brown, A L, Campione, J.C, & Barclay,C.R. Training Self-Checking Routines for Estimating 
Test Readiness: Generalization from List. Learning to Prose Recall, July 1978 (ERIC Document 
Reproduction Service No. ED, 158 226, 41p, PC-$3.32, MF-$.83) 

No. 95. Reichman, R. Conversational Coherency, July 1978 (ERIC Document Reproduction Service No. 
ED 159 658, 86p., PC-$6.32, MF-$.83) 

No. 96. Wigfieid, A, & Asher,S.R. Age Differences in Children's Referential Communication Perfor- 
mance: An Investigation of Task Effects, July 1978 (ERIC Document Reproduction Service No. 
ED 159 659, 31p.,, PC-$3.32, MF-$.83) 

No. 97: Steffensen, M.S. Jogdeo,C. & Anderson, R.C. A Cross-Cultural Perspective on Reading 
Comprehension, July 1978 (ERIC Document Reproduction Service No. ED 159 660, 4p. PC-$3.32, 
MF-$.83) 

No. 98: Green, G. M. Discourse Functions of Inversion Construction, July 1978. (ERIC Document Repro- 
duction Service No. ED 160 998, 42p., PC-$3.32, MF-$.83) 

No. 99: Asher, S.R. Influence of Topic Interest on Black Children and White Children's Reading 
Comprehension, July 1978. (ERIC Document Reproduction Service No. ED 159 661, 35p., PC-$3.32, 
MF -$.83) : 

No. 100: Jenkins, J. R, Pany, 0. & Schreck, J. Vocabulary and Reading Comprehension: Instructional 
Effects, August 1978 (ERIC Document Reproduction Sermce No. ED 160 999, 50p., PC-$3.32, MF- 
$ 83) 

No. 101 Shoben, £. J. Rips, L J. & Smith, E.E. ‘Issues in Semantic Memory: A Response to Glass and 
Holyoak, August 1978 (ERIC Document Reproduction Service No. ED 159 662, 85p.,, PC-$6.32 MF- 
$.83) 

No. 102: Baker, L, & Stein,N L The Development of Prose Comprenension Skills, September 1978 
(ERIC Document Reproduction Service No. ED 159 663, 69p.,, PC-$4.82, MF-$.83) 

No. 103. Flersher, L S.. Jenkins, J. R, & Pany, 0. Effects on Poor Readers’ Comprehension of Training in 
Rapid Decoding September 1978. (ERIC Document Reproduction Service No. ED 159 664, 39p., PC- 


$3.32, MF-$.83) 
60 


rf 


No. 
No. 
No. 
No. 


No. 
No. 


No. 


No 


No 


No 


No 


Na. 


No 


. 104: Anderson, T. H. Study Skills and Learning Strategies, September 1978.. (ERIC Document Repro- 


duction Service No. ED 161 000, 41p., PC-$3.32, MF-$.83) 


. 105: Ortony, A. Beyond Literal Similarity, October 1978. (ERIC Document Reproduction Service No. 


ED 166 635, 58p., PC-$4.82, MF-$.83) 


. 106: Durkin, D. What Classroom Observations Reveal about Reading Comprehensién patina 


October 1978. (ERIC Document Reproduction Service No. ED 162 259, 94p., PC-$6.32, MF-$.83) 


. 107: Adams, M. J. Models of Word Recognition, October 1978. (ERIC Document Reproduction Ser- 


vice No. ED 163 431, 93p, PC-$6.32, MF-$.83) 


. 108: Reder, L M.. Comprehension and Retention of Prose: A Literature Review, November 1978. 


(ERIC Document Reproduction Service No. ED 165 114, 116p., PC-$7.82, MF-$.83) 


. 109: Wardrop, J. L, Anderson, T. H., Hively, W., Anderson, R. |., Hastings, C. N., & Muller, K. E. A Frame- 


work for Analyzing Reading Test Characteristics, December 1978. (ERIC Document Reproduction 
Service No. ED 165,117, 65p., PC-$4.82, MF-$.83) 


. 110: Tirre, W. C., Manelis, L, & Leicht, K:L. The Effects of Imaginal and Verbal Strategies on Prose 


Comprehension in Adults, Recenitet 1978. (ERIC. Document Reproduction Service No. ED 165 116, 
27p., PC-$3.32, MF-$.83) 


. 111: Spiro, R. J & Tirre, W. C. Individual Differences in Schema Utilization During Discourse Pro- 


cessing, January 1979. (ERIC. Document Reproduction Service No. ED 166 651, 299., PC-$3.32, MF- 
$.83) 


. 112: Ortony, A. Some Psycholinguistic Aspects of Metaphor, January 1979. ERG Document Repro- 


duction Service No. ED 165 115, 38p., PC-$3.32, MF-$.83) 


.113. Antos, S. J. Processing Facilitation in a Lexical Decision Task, January 1949, (ERIC Document 


Reproduction Service No. ED 165 129, 84p., PC-$6.32, MF-$.83) 


. 114. Gentner D. Semantic Integration at the Level of Verb Meaning, February 1979. (ERIC Docu- 


ment Reproduction Service No. ED 165 130, 39p., PC-$3.32, MF-$.83) 

115. Gearhart, M, & Hall, W.S. Internal State Words: Cultural and Situational Variation in Vocabu- 

lary Usage, February 1979. (ERIC Document Reproduction Service No. ED 165 131, 66p,, PC-$4.82, 

MF-$ 83) 

116; Pearson, P.D., Hansen, J. & Gordon, Cc. The Effect of Background Knowledge on Young 

Children's Comprehension of Explicit and Implicit Information, March 1979. (ERIC Document Repro- 

duction Service No. ED 169 521, 26p., PC-$3.32, MF-$.83) 

117° Barnitz, J. G. Reading Comprehension of Pronoun-Referent Structures by Children in Grades 

Two, Four, and Six, March 1979. (ERIC Document Reproduction Service No. ED 170 731, 51p., PC: 

$4 82, MF-$.83) 

118. Nicholson, T., Pearson, P.O, & Dykstra, R. Effects of Embedded Anomalies and Oral Reading 

Errors on Children's Understanding of Stories, March 1979. (ERIC Document Reproduction Service 

No. ED 169 524, 43p., PC-$3.32, MF-$.83) 

119° Anderson, R. C., Pichert, J. W., & Shirey, LL Effects of the Reader's Schema at Different Points 

in Time, April 1979. (ERIC Document Reproduction Service No. ED 169 523, 36p., PC-$3.32, MF-$.83) 

120: Canney. G, & Winograd, P. Schemata for Reading and Reading Comprehension Performance, 

April 1979. (ERIC Document Reproduction Service No. ED 169 520, 99p., PC-$6.32, MF-$.83) 

121 Hall, W.S, & Guthrie, L F. On the Dialect Question and Reading, May 1979. (ERIC Document 

Reproduction Service ED 169 522, 32p., PC-$3.32, MF.$.83) 

122, McClure, £, Mason, & & Barnitz, J. Story Structure and Age Effects on Children's Ability to 

Sequence Stories, May 1979. (ERIC Document Reproduction Service No. ED 170 732, 75p., PC-$4.82, 

MF-$.83) 

123 Klerman, GM, Winograd, P.N. & Humphrey, M.M. Prosody and Children's Parsing of Sen- 

tences, May 1979. (ERIC Document Reproduction Service No. ED 170 733, 28p.. PC-$3.32, MF-$.83) 

124. Spiro, R. J. Etiology of Reading Comprehension Style, May 1979. (ERIC Document Reproduction 

Service No. ED 170 734, 21p., PC-$1.82, MF-$.83) 

125° Hall. WS. & Tirre. WC. The Communicative Environment of Young Children: Social Class, 

Ethnic, and Situational Differences, May 1979 

126. Mason. J..& McCormick. C. Testing the Development of Reading and Linguistic Awareness, 

May 1979. (ERIC Document Reproduction Service No. ED 170 735, 50p., PC-$3.32, MF-$.83) 

127 Brown, A L. & Campione, J.C. Permissible inferences from the Outcome of Training Studies in 

Cognitive Development Research, May 1979. (ERIC Document Reproduction Service No. ED 170 736, 
PC-$3 32. MF-$.83) 


6] 


No 128 Brown, AL, & French,L. A. The Zone of Potential Development: Implications for Intelligence — 
Testing in the Year 2000, May 1979. (ERIC Document Reproduction Service No. ED 170 737, 46p., 
PC.$3.32, MF-$.83) 

No. 129° Nezworski, T, Stein, N L. & Trabasso, T Story Structure Versus Content Effects on Children's 
Recall and Evaluative inferences, June 1979. 

No 130: Bruce, B. Analysis of Interacting Plans as a Guide to iad \etionctibiee of Story Structure, 
June 1979. 

No 131 Pearson; P 0, Raphael, T, TePaske, N. & Hyser, C. The Function of Metaphor in Children's 

——Reeall of Expository Passages, July 1979 

No 132 Green.G M Organization, Goals, and Comprehensibility in Narratives: Newswriting, a Case 
Study, July 1979 i. 

No 133 Kleman.GM_ The Scope of FROMALOS of Word Recognition from Single Word and Sentence 
Frame Contexts, July 1979 

No 134 McConkie.G W, Hogaboam, T. W, Wolverton,G S. Zola,D. & Lucas,P A Toward the Use of 
Eye Movements in the Study of Language Processing, August 1979 = 

No 135 Schwartz.R M_ Levels of Processing: The Strategic Demands of Reading Comprehension, 
August 1979 

No 136 Anderson, R C, & Freebody, P Vocabulary Knowledge, August 1979 

No 137 Royer. J M. Hastings. CN, & Hook, C A Sentence Verification Technique for Measuring Read- 

~ ing Comprehension, August 1979 

No 138 Spiro.R J rior Knowledge and Story Processing: Integration, Selection, and. Variation, 
August 1979 

No 139 Asher.S R. & Wigfield, A Influence of Comparison Training on Children’s Referential Commun- 
ication, August 1979 

No 140 Aless:t.S M. Anderson, T H. & Goetz, £ T An Investigation of Lookbacks During Studying, Sep 
tember 1979 

No 141 Cohen. P R. & Perrault.C R Elements of a Plan-Based Theory of Speech Acts, September 
1979 ; 

No 142 Grueneich. R. & Trabasso. T The Story as Social Environment: Children's Comprehension and 
Evaluation of Intentions and Consequences, September 1979 

No 143 Hermon. G On the Discourse Structure of Direct Quotation, September 1979 

No 144 Goetz. — T. Anderson. R C. & Schallert.D L The Representation of Sentences in Memory, Sep- 
tember 1979 

No 145 Baker. l Comprehension Monitoring: Identifying and Coping with Text Confusions, September 
1979 


62 


